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FUZZY GENETIC LEARNING AUTOMATA CLASSIFIER 

GOVERNMENT RIGHTS 
[0001] The U.S. Government has certain rights in this invention pursuant to 
the clause at FAR 52.227-12. 

BACKGROUND OF THE INVENTION 

1. Field nf the Invention 

[0002] This invention relates generally to signal classifiers, and, more 
particularly, to a signal classifier which employs fuzzy genetic learning automata. 

2. Discussion of the Related Art 

[0003] Typical passive sensor systems which collect wideband signals are 
receiving an enormous flux of information from a continually evolving signal 
environment. This enormous flux of information threatens to exceed the capacities 
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of the human signal analysts to analyze the data. As a result, there is a pressing 
need for artificially intelligent systems which quickly analyze the arriving data 
stream, and, while so doing, effect machine learning in order to adapt to the 
continual signal-environmental changes. The intelligent systems should filter the 
signal data by identifying and separating known signals from the arriving flux of 
signal information. This potentially reduces the workload for the human signal 
analyst by allowing him/her to focus attention on signal features which are more 
likely to contain mission-important information. 

[0004] Adaptive front-end signal classifiers are generally known in the art. 
Conventional front-end signal classifiers utilize many inner product-based schemes 
which compare the arriving signal to a set of basis functions that serve as 
exemplary signals. These inner product-based schemes may be based on Fourier 
analysis, wavelets, and/or Gabor transforms. In each of these schemes, the 
computational intensity is high and there is little flexibility to adapt to a changing 
signal environment. 

[0005] Therefore, it is desirable to provide an adaptive signal classifier which 
learns to identify specific embedded spatiotemporal signals in an arriving signal data 
stream of an evolving signal environment. More specifically, it is desirable to 
implement a signal classifier using fuzzy automata. Fuzzy automata generally use 
min-max aggregation to process the incoming data, thereby obviating the need for 
highly intense inner product-based comparisons to exemplary signals. Since each 
fuzzy automata is a language-learning system, only one requirement needs to be 
imposed on the signals that are to be acquired: a signal needs to be 
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characterizable as occurring in one or more states and transitioning as a whole or 
partially among some or all states over time. Thus, the formal language framework 
of fuzzy automata is particularly well-matched to signal separation applications. In 
addition, the operation of each fuzzy automaton is independent of the durations of 
the incoming signals. 

SUMMAR Y O F T HE INVENTION 
[0006] In accordance with the teachings of the present invention, a method is 
provided for deriving a near-optimal fuzzy automaton for a given separation 
problem. The method includes the steps of: (a) forming a first generation 
population of fuzzy automata, where the first generation population of fuzzy 
automata includes a plurality of fuzzy automata; (b) performing a mutation 
operation on each fuzzy automaton in the first generation population of fuzzy 
automata; (c) reproducing the first generation population of fuzzy automata using a 
survival of the fittest operation; and (d) applying a cross-over operator to the 
reproduced first generation population of fuzzy automata, thereby yielding a next- 
generation population of fuzzy automata. A near-optimal fuzzy automaton is 
identified by evaluating the performance of each fuzzy automaton in the population; 
otherwise the methodology is repeated until a near-optimal fuzzy automaton is 
derived for the given separation problem. 

[0007] Additional objects, features and advantages of the present invention will 
become apparent from the following description and appended claims taken in 
conjunction with the accompanying drawings. 



TRW Docket No. 15-0247 



BRIEF DESCRIPTION OF THE DRAWINGS 
[0008] Figure 1 is a diagram depicting an exemplary signal classifier 
implemented in accordance with the present invention; 

[0009] Figures 2A and 2B are flowcharts illustrating a method for deriving 
near-optimal fuzzy automata for a given separation problem in accordance with the 
present invention; 

[0010] Figure 3 is a diagram depicting an exemplary crossover operation 
between two fuzzy automata in accordance with the present invention; and 
[0011] Figure 4 is a flowchart illustrating a method for deriving a signal 
classifier in an evolving signal environment in accordance with the present invention. 

DETAILED DESCRIPTION OF THF PRFFFRRFD FMRODIMFNTS 

[0012] Figure 1 illustrates an exemplary signal classifier 10 that is implemented 
using fuzzy genetic learning automata in accordance with the present invention. 
Each of the fuzzy genetic learning automata are dedicated to learning and separating 
a specific signal or a particular set of signals from an evolving signal environment. As 
will be apparent to one skilled in the art, two or more fuzzy automata may be used to 
implement the signal classifier 10. In a preferred embodiment, each of the fuzzy 
automata are implemented as individual software agents. 

[0013] In operation, the signal classifier 10 receives a plurality of input signals 
12 from a signal environment. The input signals 12 are evaluated by each of the 
fuzzy automata. For illustration purposes, a first automaton, Ui,3, is intended to 
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classify Signals 1 and 3 and distinguish them from Signal 2; whereas a second 
automaton, Lb, is intended to classify Signal 2 and distinguish it from Signals 1 and 3. 
Each fuzzy automaton outputs a confusion matrix, where the rows of the matrix are 
output vectors arranged according to the input signals. For instance, when Signal 1 is 
presented to the first automaton, Ai t 3, the first row of the confusion matrix is ideally [1 
0 0]. Similarly, when Signal 3 is presented to the first automaton, Ai,3, the third row of 
the confusion matrix is ideally [0 0 1]. Likewise, when Signal 2 is presented to the 
second automaton, A2, the second row of the confusion matrix is ideally [0 1 0]. 
Thus, the resulting output from the signal classifier 10 is an aggregate confusion 
matrix 14 having the appropriate rows from each of the individual automata. In this 
example, the first and third rows of the aggregate confusion matrix correspond to the 
first and third rows of the confusion matrix from the first automaton, and the second 
row of the aggregate confusion matrix corresponds to the second row of the 
confusion matrix from the second automaton. It is noteworthy that the aggregate 
performance of a signal classifier built from two or more fuzzy automata is typically 
better than the performance of each individual fuzzy automaton. 
[0014] A method for deriving a near-optimal fuzzy automaton for a given 
separation problem is shown in Figures 2A and 2B. In accordance with the present 
invention, the near-optimal fuzzy automata may then serve as the basis for a signal 
classifier. First, a separation problem must be identified 22 from the signal 
environment. A separation problem, £, is a set of signals {Signal 0, Signal 1, 
Signal ^} that need to be separated from each other. Each of the signals is further 
defined as a vector labeled with time, such as At = [a*o, aS, ... , aVi], t = 0, 1, ^. 
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Near-optimal fuzzy automata can then be derived for the given separation problem. 

A fuzzy automaton is a well known type of mathematical object as described by 
George J. Klir and Bo Yuam in the text Fuzzy Sets and Fuzzy Logic, Theory and 
Applications , Prentice Hall, 1995. A fuzzy automaton, U, may be represented by a 
quintuple U = (uS, uR, uE°, A*, B*), where uS is an ixixm matrix of fuzzy state 
transitions for fuzzy automaton U; uR is an p matrix of fuzzy output transitions for 
fuzzy automaton U; uE° is an initial vector of fuzzy state memberships of length t\ 
A is a space of input vectors, each vector having length m; and B* is a space of 
output vectors, each of length p. 

[0015] Initially, an input set of fuzzy automata is chosen stochastically by 
pulling elements of S, R, and E° at random from the unit interval until a set of fuzzy 
automata with some positive separability is realized. A population of fuzzy 
automata, { 9 U°, 9 U 1 , 9 U 71 " 1 }, is then formed 24 by randomly selecting a subset 
from the input set of fuzzy automata. In this notation, a fuzzy automaton, U, 
belongs to a certain generation as designated by a pre-superscript, g, where g is a 
non-negative integer. Likewise, a post-superscript is used to designate a particular 
member of the population. Thus, a first generation population of fuzzy automata is 
represented as{ 1 U°, V, 1 LT 1 }. 

[0016] A genetic algorithm is iteratively applied to the population of fuzzy 
automata until a near-optimal fuzzy automaton is derived for the given separation 
problem. In general, a genetic algorithm is a model of learning which derives its 
behavior from a metaphor of the processes of evolution as they occur in nature. In 
nature, the members of a population are derived from and represented by 
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chromosomes. Likewise, the members of a population of fuzzy automata must be 
represented in a chromosome paradigm in order to apply a genetic algorithm. 
[0017] In accordance with the present invention, at least the first three 
elements of the quintuple U, which are uS, uR, uE°, are redefined 26 in chromosome 
form. In particular, each data value of each matrix which comprises an element of 
the fuzzy automaton is represented as a binary word. For example, uS is defined as 
follows: 



u 



S = 



U ^0,0,0 U ^0,1,0 

U S 1,0,0 U S 1,1,0 



U ^-1,0,0 u^-uo 



U^0,£-1,0 
U S U-1,0 



u^-u-1,0. 



E/ ^0,0,1 




' U^0 9 £-l 9 l 


£7^1,0,1 


u^ixi 


' U^l,£-U 


*y ^-1,0,1 




" U^£-\,£-U 



\j\o,m-l U^0,l s iw-1 
\j\o,m-l U^lXm-l 



U^-l,0,w-l U^-1,U»-1 



U°0,M,m-l 
U^W-l 9 m-l 



\J°£-U-lm-l 



where each data value is u\ Xi = lu S h,ij) 0 °lu S h,i,j) l ° 0 lu S hAj) w _i such that 
each term (uS hi j) k in the concatenation is an element of {0, 1} and 0 is the 
concatenation operator. Accordingly, each data value, u^h,y > of the matrix is a 
chromosome, e.g., 00101. ..0011, of some length n. As will be apparent to one 



skilled in the art, uR and uE° can be similarly redefined in chromosome form. 
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[0018] A mutation operation can then be applied 28 to each of the fuzzy 
automata in the population. To effect mutation, a small number of data entries in S, 
R, and E° for each automaton are randomly selected. For each entry, a random 
location along the bit string is flipped from 0-*1 or 1^0. The bit flip function, 3 , 
on the set {0, 1} may be defined as 3(6) = (6+l)(modw/o2) j where b is a member 
of {0,1}. In a preferred embodiment, mutation only occurs in the semi-automaton { 
uS, uR, uE° }. 

[0019] For illustration purposes, consider a 2x4x3 fuzzy automaton where the 
random entries chosen for mutation are marked with a star as follows: 



Thus, there are two data entries where mutation by bit flipping occurs: uSi,i,o and 
uro f 2- Within each data entry, a random location is then selected. For example, 
suppose that the third bit is flipped for uSi,i,o and the fifth bit is flipped for uro,2. The 
resulting mutation operation would be as follows: 

(u S UoJ 0 °(u S Uo)! ° tu S l,l,o) 2 °- °(u S Uo) 7 => 

(u s i,i,o ) 0 ° (u s u,o \ ° 3 ((u s u,o ) 2 ) ° * • • ° (u s u,o ) 7 

and 

lu r 0,2) 0 °(v\l\ ° (u r 0,2) 2 °"' ° tu r 0,2) 7 => 

(u r 0,2 ) 0 ° (u \2 \ ° - ° 5 ((u \2 \ ) ° (u r 0 s 2 ) 6 ° (u \l \ - 
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One skilled in the art will readily recognize that the above description is merely 
exemplary of a mutation operation. It is envisioned that other rules may be devised 
for effecting a mutation operation within the scope of the present invention. 
[0020] Next, the first generation population of fuzzy automata is reproduced in 
accordance with a survival of the fittest operation. As will be more fully explained 
below, reproduction involves the following three steps: (1) evaluating the fitness 30 of 
each fuzzy automata in the population, (2) ranking the fuzzy automata 32 within the 
population according to the fitness of each fuzzy automata, and (3) reproducing at 
least one of the fuzzy automata 34 in accordance with some reproduction rule. 
[0021] First, each of the fuzzy automata are evaluated for fitness via a fitness 
function. In a preferred embodiment of the present invention, the fitness of each 
fuzzy automaton is assessed using a diagonal dominance indicator. While the 
following description is provided with reference to a particular fitness function, it is 
envisioned that other known fitness functions fall within the broader aspects of the 
present invention. 

[0022] In order to determine a diagonal dominance indicator for a fuzzy 
automaton, a set of input signals must be identified from the signal environment. The 
set of input signal are evaluated by each fuzzy automaton in the population, thereby 
yielding a confusion matrix for each fuzzy automaton. A diagonal dominance 
indicator is computed for each confusion matrix, where a figure of merit for diagonal 
dominance, D, is provided as follows: 

D = (Csmallest on-diagonal — Clargest off-diagonal) / ((Csmallest on-diagonal + 
Clargest off-diagonal)/2). 
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For illustration purposes, the diagonal dominance indicator for an exemplary 

confusion matrix of 

"1.17 .21 .23" 
.00 1.24 .36 
.10 .22 1.26 

is computed as D = (1.17 - 0.36)/((1.17+0.36)/2) = 1.06. As will be apparent to one 
skilled in the art, a diagonal dominance indicator for a confusion matrix may be 
computed in accordance with other known figures of merit. 
[0023] Second, each of the fuzzy automata in the population are ranked 
according to the fitness of the individual automaton, where the diagonal dominance 
indicator is indicative of the fitness of an automaton. More specifically, the fuzzy 
automata are ranked from the fuzzy automata having the largest diagonal dominance 
to the fuzzy automata having the smallest diagonal dominance. 
[0024] Third, at least one of the fuzzy automata in the population is 
reproduced in accordance with a reproduction rule. In accordance with a survival of 
the fittest approach, the reproduction rule is fashioned such that the highest ranking 
fuzzy automata are reproduced and the poorest ranking automata are eliminated. 
For example, given a population of eight fuzzy automata, an exemplary reproduction 
rule may specify that the two highest ranking automata are duplicated, the four 
middle ranking automata are maintained, and the lowest two ranking automata are 
eliminated. This exemplary reproduction rule is illustrated as follows: 

( V, 9 u 1 , g u 2 , V, V, 9 u 5 , 9 u 6 , V ) => 

{ V, V, g u 1 , 9 u\ V, g u 3 , 9 u 4 , g u 5 } 

This particular reproduction rule has the advantage of maintaining a constant 
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population size of eight. It is envisioned that other types of reproduction rules fall 
within the scope of the present invention. 

[0025] Once the population of fuzzy automata is reproduced in accordance 
with a survival of the fittest operation, a unique crossover operator may be applied 
36 to the population of fuzzy automata. In general, fuzzy automata crossover 
operates on two fuzzy automata, U and V, from a particular generation of automata, 
and produces two new fuzzy automata, W and X, belonging to a next generation of 
the population. More specifically, the crossover operator is specified as a transform 
Sf which maps the tuple of input automata (U, V), to the tuple of output, next- 
generation automata (W, X). In other words, the crossover operator may be 
expressed as 

BfUU.V)) = (W,X) 

As will be described below, only the state transitions # S, the response transitions # R, 

and the initial states .E are involved in the crossover operation. The spaces A* and 

B* are not involved in the crossover operation. 

[0026] In the transform s Y , the label *p is an ordered triple *p = (^s, Tr, ^Feo), 
where *Fs, *Fr, Yeo are matrices having the same dimensions as .S, 9 R, and ,E°. 
The entries in the arrays are numbers from the set {1, 2, n -1}, such that the 
entries determine the alleles of the crossover. In other words, the entries determine 
the points along the chromosomes where crossover is to occur. These matrices 
are expressed as follows: 



w = 



k k 

s ; 0,0,0 S; 0,1,0 



^S;i,o,o 



k s;i,i,o 



k s;£- i 5 o,o k s;^- i s i,o 



' s ;o,^-i,o 
ws ;u-i 5 o 



^-1,^-1,0 



K S; 0 ,o,l 

ks ;i,o,i 



k 



s ; o,u 
:s ;i,u 



k s;^- 1,0,1 k S;£- w 



0,^-1,1 
: S;i,£-l,l 



-11- 



TRW Docket No. 15-0247 



k k 

S;0,0,m-1 S;o,i, w -i 



' s H,0,/n-l 



ks ;um-i 



k k 

s ;*-l,0,m-l s ^-1,1,jw-1 



" s ;o^-i,m-i 
'" s ;i/-i,ot-i 



" s ^-U-l,m-l 



R 



k R;o, 0 k R;o,i 



k R;i,o 



k R; u 



k R;o )P -i 
k R;i, P -i 



k R^-i, P -i 



k E 0 ;0 k E 0 ;l 



k E 0 ;^-l 



[0027] The operation of the transform 3^ can be further specified in view of 
this definition for In particular, each element of the fuzzy automata W and X are 
further expressed in terms of the elements of U and V. For instance, the first element 
of W, wS, is generated as follows: 



w s h,y = luS h ,y)o °lu s h,yA 0 - °luSh,y) k _i °(v s Khj\ 

S;h,i,j 



S; h, i, j 



for each data value wSh.u within wS. In other words, wSh.ij obtains its front 
portion from uSh.ij and its tail portion from v Sh,ij. It is noteworthy that ks ; h.ij from Ts 
is used to identify the crossover point within the binary word that represents each 
data value. 
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[0028] The second element of W, wR, is generated similarly as follows: 

w r h,i, j = lu r h,ij I ° (u r h,i,j A 0 °lu r h,i,j I . . .-i 0 Iv r h,i,j L . . . ° • • • 0 U r h,i, j ) n _! 

for each data value wrh.ij within wR. Likewise, the third element of W, wE°, is 
generated as follows: 

w e° = ( TT e° ) oLeJ..) °-°( TT e° ) oLeJ.. ) o...o( v e° ) 

W h,i,j VU h,i,j/ 0 W h^j/j \U h,i,j/ k _! W v h } i,j/ k W ^J/n-l 

E°;h,i,j E0;h,iJ 

[0029] The next generation fuzzy automaton, X, is generated in a similar 
manner. However, in this instance, the front portion of the chromosome comes from 
V and the tail portion of the chromosome comes from U. Each element of X is further 
expressed below. The first element of X, xS, is generated as follows: 

xShAj = (vS U jJo °lvS U ji ° "' °lvS h ,i,j) k , 4uS h5 y) k o ... o^.J 

S;h,ij S;h,i 5 j 

for each data value within xS. The second element of X, xR, is generated as 
follows: 

x r h,i,j = U r h 5 y J 0 ° U r h,y \ ° " • ° (v hxi l h ..-i° lu r h,i, j I . . ° ' " ° lu r Uj L 

K;n,i,j K.;n,i,j 

for each data value xR. The third element of X, xE°, is generated as follows: 

„e° = Let-) o( v e2..) ° - o( v e!! • •) °Lel ■) ---Let-) 

E°;h,iJ E°;h,iJ 

for each data value of xE°. Thus, the crossover transform has been described in 
complete detail. 

[0030] For illustration purposes, an exemplary crossover operation is illustrated 
below. Suppose U and V are as follows: 
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0001101010 0011111011 

0001101001 0000100011 

0010011011 0011100000 

0000101011 0000111101 



uR = vR, and uE° = vE°. In addition, the crossover allele, *f, is 



8 


8 




8 


8 




8 


8_ 




CO 


8_ 





where and Yeo are arbitrary since uR = vR, and uE° = vE°. The operation of 
on U and V to produce W and X is illustrated in Figure 3. The bits originating with V 
are shown in bold italic type; whereas those originating with U appear in regular 
type. As shown in Figure 3, W receives the front portions of the bit strings from U 
and the back portions of the bit strings from V, while X receives the front portions of 
the bit strings from V and the back portions of the bit strings from U. Although the 
same allele location k for each element of S was used in the above example, this is 
not intended as a limitation on the values of S. On the contrary, different allele 
locations k may be suitably used in S. 

[0031] Although the present invention is not limited as such, the above- 
described crossover operation is applied to the first generation population of fuzzy 
automata by randomly selecting pairs of fuzzy automata from the population and then 
applying the crossover operator to each pair of fuzzy automata. For a population of 
eight fuzzy automata, the crossover operator is applied to four randomly selected 



uS = 



0011000000 
0011011111 



0000100111 
0011000101 



vS = 



0100010110 0010110101 
0000110000 0001011011 
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pairs of fuzzy automata. In this way, a next generation population of fuzzy automata 
have been derived for the given separation problem. 

[0032] Lastly, each of the fuzzy automata in the next generation population is 
evaluated for performance 38 in view of the given separation problem. In a preferred 
embodiment, each fuzzy automaton is evaluated using the above-described fitness 
function. If one of the fuzzy automata exceeds some predefined performance 
threshold (e.g., a minimum diagonal dominance value), then algorithm is complete, 
thereby yielding a near-optimal fuzzy automaton 40 for the given separation problem. 
On the other hand, if none of the fuzzy automata in the next-generation population 
exceeded the performance threshold, then the process is repeated starting with the 
next-generation population serving as the input to the mutation operation. The 
genetic algorithm of the present invention can be repeated until at least one fuzzy 
automaton exceeds the performance threshold associated with the given separation 
problem. As will be apparent to one skilled in the art, employing a genetic algorithm 
having the basic elements of mutation, reproduction of the fittest, and crossover 
guarantees convergence upon a near-optimal solution for the given separation 
problem. While the above description of the present invention has been provided 
with reference to a particular genetic algorithm, there are other known generation- 
level genetic operations (e.g., blended crossover, gray coding, etc.) which may be 
incorporated into the overall framework of the present invention. 
[0033] A signal environment, € (r) , will typically evolve over time. For an 
individual signal in the environment, the time variable t may be used to designate 
"fast time". However, the signal environment will ordinarily evolve over "slow time" % 
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(which may also be referred to as epoch). Accordingly, the separation problem z(t) 
will also typically evolve over time. 

[0034] Referring to Figure 4, a method is provided for deriving a signal 
classifier in an evolving signal environment. As previously described, a single fuzzy 
automaton at a fixed epoch in history % must learn to acquire a subset of signals 
within the environment. In addition, the fuzzy automaton must also not confuse 
these signals with the other signals in environment. If multiple fuzzy automata are 
needed to resolve the separation problem, then the separation problem e(t) may be 
partitioned 42 into a set of separation problems {(S(x))o, (E(x))i,..., (E(x)) r i,}, such 

thats(x) = (J 

i = 0 

[0035] In accordance with the present invention, a near-optimal fuzzy 
automaton may be derived 44 for each individual separation problem using the 
above-described genetic algorithm. Thus, each of the fuzzy automata would learn 
to produce positive diagonal dominance for the signals representing its part of the 
problem (£(<>);, as well as not to have diagonal dominance for the rest of the signal 

problem e( t )\CS(*))/ ■ 

[0036] An aggregate confusion matrix can be formed 46 from the resulting 
set of near-optimal fuzzy automata. The aggregate confusion matrix is used to 
evaluated 48 the set of fuzzy automata in view of the overall separation problem. If 
the set of fuzzy automata exceeds some predefined performance threshold, then the 
set of fuzzy automata can be used as the basis for a signal classifier. On the other 
hand, if the set of fuzzy automata does not exceed the performance threshold, then 
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the separation problem is repartitioned, and the process is repeated. Likewise, the 
signal classifier is periodically re-evaluated over time as shown at 52 in order ensure 
that its performance meets some minimum performance threshold. If the signal 
classifier does not exceed the performance threshold, then the above-described 
methodology is reapplied to the separation problem. In this way, changes in the 
environment are learned as the epoch is advanced. 

[0037] The foregoing discussion discloses and describes merely exemplary 
embodiments of the present invention. One skilled in the art will readily recognize 
from such discussion, and from the accompanying drawings and claims, that various 
changes, modifications and variations can be made therein without departing from 
the spirit and scope of the invention as defined in the following claims. 
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